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Abstract 



Recognition of the Importance of graphic displays as communication devices 
has led to Increased efforts 1n the past decade to convert such displays Into 
a form compatible with the perceptual capabilities of blind persons. This 
has resulted 1n the Investigation of a number of concerns* Including methods 
of production, display design, and display-reading skills. One area, graphic 
Interpretation training, has, however* received a paucity of attention. This 
1s particularly evident for the frequently encountered category of displays 
known as graphs. This paper describes an effort to develop an Instructional 
program 1n tangible graph Interpretation for braille readers. Based on 
analyses of typical graph reading tasks* skills and concepts fundamental to 
the graph reading process were Identified and then Incorporated Into a 
logically sequenced Instructional program. A high priority was given to the 
application of relevant research findings 1n the areas of display design and 
skills training. The effectiveness of the program was assessed using 60 
braille readers 1n grades 5-10. The results of this evaluation Indicated 
that substantial gains 1n graph literacy could be realized with the program 
1n a relatively short amount of tine. 
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Introduction 



Graphic displays are useful tools for communicating certain types of 
information which cannot be easily or efficiently represented in verbal form. 
Recognition of this capability is reflected 1n the growing usage of nonverbal 
material, a trend that is expected to continue into the foreseeable future 
(Kirchner, 1979). There simply does not seem to be a more effective vehicle 
for conveying such information as the spatial relationships of the components 
of a map, the schematic representation of an object in a diagram, or the 
relationships between variables in a graph, Any person, regardless of visual 
status, is placed at a disadvantage if not provided access to the wealth of 
information available in graphic displays. 

Recognition of this fact in the field of the blind has led to increased 
efforts in the last decade to convert visual graphics into tangible form. 
This has resulted in the investigation of a number of concerns, including 
methods of production (Barth, 1982; Gill, 1973b; Jams, 1975; Bentzen & Peck, 
1979; Berla' & Butterfield, 1977a; Berla' & Murr, 1975a; Lederman & Campbell. 
1982; Lederman S Kinch, 1979; Nolan & Morris, 1971; Schiff, Kaufer, & Mosak, 
1966; Wiedel & Groves, 1969), and display-reading skills (Berla 1 , 1973; Berla', 
1981; Berla* & Butterfield, 1977b; Berla', Butterfield, & Murr, 1976). This 
last category has primarily involved the determination of, or training in, 
specific systematic skills for effective display examination. Projects con- 
cerned with the more global aspect of graphic interpretation training have 
been more scarce. In the area of map interpretation, some training programs 
have been developed: Maps in the Classroom I (Franks, 1982); Maps in the 
Classroom II (Franks, 1974); Landform Models (Franks & Balrd, 1971a; Franks & 
Baird, 1971b); Simplified Continental Relief Maps—Cassette Program (Franks, 
1979). Although not an actual program, a very useful set of guidelines has 
been described by Bentzen (1980) for the systematic development of mobility- 
map interpretation. No systematic training programs are available for ether 
types of graphic displays. 

Tangible graphs fall into this neglected category, despite the fact that 
they represent a significant proportion of the graphics that appear 1n print. 
Their importance as a communications tool is attested to by the 'requency with 
which they appear 1n textbooks and other educational media, in such diverse 
subject areas as mathematics, social studies, physical sciences, biological 
sciences, and business. They are increasingly encountered 1n newspapers and 
magazines. Interestingly, in a position paper on basic machematical skills 
(1977), the National Council of Supervisors of Mathematics identified the 
reading and interpretation of graphs as one of 10 basic skills areas that need 
to be emphasized in mathematics education. The development of graph skills 
was also identified as a high priority by six prominent mathematics educators 
in a needs meeting conducted by the American Printing House for the Blind 
(1979). Graph literacy is thus expected of any educated person and is 1n 
fact tested in standardized educational measures such as the Stanford Achievp- 
ment Test, the California Achievement Tests, the Scholastic Aptitude Test 
(SAT), and the American College Testing Program (ACT). The college-bound or 
career-bound bVlnd person wi^l be particularly handicapped by an inability to 
read graphs. A review of the literature on tangible graphic displays by 
Berla' (1982) noted both the lack of research and development and the need for 
instructional materials 1n the area of graphs. This conclusion was "choed in 
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a Workshop on Tangible Graphic Displays held 1n 1979 at the University of 
Louisville (Schiff, 1982). Seventeen blind participants from a variety of 
backgrounds reached a general consensus that the use and Interpretation of 
graphic displays, Including graphs, have not received the attention they 
deserve. They recommended that intensive training materials be introduced at 
an early point in the education of visually handicapped students. As Peter 
Selby (1976) has pointed out, "Wich the growing use of graphs and tables to 
summarize data from every branch of science, Industry, business, and govern- 
ment, all of us need to be familiar with their purpose and use** (p + 1) + 

Program Development 

"The Development of Fundamental Skills in Tactile Graph Interpretation: 
A Program for Braille Readers" represents an effort to bridge this gap in a 
blind student's education. In developing this program, now entitled Tangible 
Graphs , the following activities were carried out sequentially: (a) the 
identification of fundamental graph reading skills, concepts, and operations, 
(b) the Incorporation of these skills, concepts* and operations Into a graph 
test, (c) the development of an instructional program, (d) field evaluation, 
and (e) revision and production. 

The first activity laid the foundation for the entire project* Skills, 
concepts, and operations fundamental to the graph reading process were derived 
by rigourously analyzing the explicit (what information is being sought) and 
Implicit (what skills, concepts, and operations are assumed) tasks required 
by the graphs which appear in textbooks* graph instructional programs for the 
sighted, and standardized academic tests* The types of graphs commonly used 
and the grade level at which each type is typically encountered were also 
identified during this search and analysis phase of the project. 

Forty textbooks in the areas of mathematics* social studies, science, and 
business from grades 2-12 were scrutinized. Those chosen were considered 
representative of the textbooks commonly used 1n the educational system. All 
of them were, in fact, selected by the Editorial Department of the American 
Printing House for the Blind for transcription into braille after a careful 
review process* The graph content of two standardized tests was also analyzed. 
These were the Stanford Achievement Tests (grades 2.5-12) and the KeyHath 
Diagnostic Test (preschool to grade 6), In addition, 14 print graph instruc- 
tional programs were identified and their contents examined in detail. These 
task analyses resulted in the identification of approximately 70 skills* con- 
cepts, and operations (see Appendix A) that are needed to Interpret the infor- 
mation contained in four main types of graphs: pictographs, bar graphs, line 
graphs, and circle graphs. 

A criterion-referenced, multiple-choice test was then developed for 
assessing a student's attainment of these skills and concepts. The test has 
a twofold purpose: (a) to serve as a diagnostic Instrument for determining a 
student's level of mastery prior to entry Into the program (where to start) 
and subsequent to Instruction (further emphasis, remediation) and (b) to serve 
as an assessment Instrument 1n the program evaluation phase of the project. 
The list of skills and concepts and the test itself were critically reviewed 
and revised by a committee of consultants composed of one curriculum specia- 
list 1n mathematics instruction and six mathematics and social studies teachers 
from residential and public school programs for the blind (see Appendix 8). 
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In constructing the instructional text Itself, the objective was to 
develop the fundamental graph reading skills and concepts In a systematic, 
logical sequence of increasing difficulty or complexity. The approach taken 
was basically an amalgamation of two skills training techniques, the part- 
continuous method (Holding. 1965) and the linear programming method. In the 
part-continuous approach to training, the parts making up a skill are pre- 
sented to the learner one at a time. As each new part Is presented, it Is 
practiced In conjunction with previously learned parts until the entire skill 
is built up. The linear programming method follows a similar strategy and 
further specifies that the sequential steps used in developing a skill or 
concept be small in size. This Is to Insure that each step Is understood by 
the learner, thus avoiding frustration and providing positive reinforcement. 
Such systematic approaches were found to be lacking In existing graph Instruc- 
tional programs for the sighted. These programs typically used large or 
extremely erratic step sizes and In many cases did not even attempt to develop 
a logical progression of complexity either within graph types (for example, 
presenting a multiple line graph prior to a single line graph) or between 
graph types (for example, presenting line graphs prior to bar graphs or picto- 
graphs). In addition, all of these programs made assumptions about prior know- 
ledge of various skills and concepts, although these assumptions differed 
between programs. 

Based on the fact that blind students characteristically exhibit poor 
tactual display-reading skills (Berla', Butterfleld, & Murr, 1976; Nolan & 
Morris, 1971) and generally receive little Instruction In graphic interpreta- 
tion (Berla', 1982), 1t was decided that the present program should begin, as 
it were, at the beginning. Consequently the first part of the program, or 
approximately 25% cf the 164 page text, Is devoted to the development of skills 
and concepts that are prerequisites to the effective Interpretation of any 
tangible graphic display. Thus, the text begins with an examination of points, 
lines, and areal patterns, the building blocks of all graphic displays. Dis- 
tinctive features of symbols both within and between these three symbol classes 
are discussed; perceptual training is given In the form of pair comparison and 
matching tasks. The symbol sets are presented in bcth paper and plastic 
(Prailon) media to acquaint the student with the characteristics of each. 
Both media are used throughout the program, In approximately equal proportions. 

The program then proceeds to a discussion of directional and locational 
referents, both with respect to the layout of the page itself and the inter- 
relationships of elements appearing on a page. This Is followed by training 
in the skills of systematically scanning a display (Berla 1 , 1981; Berla' & 
Murr, 1974) and of tracking lines by the two-finger method (Berla', 1973). 
These skills are practiced on displays of increasing complexity, from lines 
In Isolation to Intersecting lines to lines embedded In points and areal pat- 
terns. Much of the work Is couched In the form of games to elevate student 
Interest. Concepts are the* presented which are esst^tial to an understanding 
of the interrelationships o* lines, the most frequently used c*ass of symbols 
in graphs. These Include such concepts as horizontal, vertical, diagonal, 
parallel, perpendicular, Intersecting, longer, and higher. 

At this point the program focuses on concepts more directly related to 
graphs, beginning with an exposition on number lines. Plctographs are pre- 
sented next and are then used to develop an understanding of simple bar graphs. 
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After exploring the distinctive features common to all graphs {title, axes, 
axes labels), the Idea that a given location in two dimensional space can be 
specified by means of a coordinate reference system is introduced. This pro- 
ceeds from a discussion of rows and columns (layout of desks in classroom; 
tables) to the layout of streets In a map to the grids used Ui graphs. Point 
location exercises follow, again In game form. 

Bar graphs are then used to develop an understanding of simple line 
graphs. The interpretation of increasing and decreasing line trends is par- 
ticularly emphasized in this section. Following a discussion of circle graphs, 
the program returns to line graphs to deal with more complex concepts such as 
slope and tne presentation of multiple data curves In a single display. Dis- 
cussions and exercises in this concluding section of the program focus pri- 
marily on the process of comparing two or more data curves. 

Throughout the program, an active student role is fostered, not only in 
examining and Interpreting the numerous displays presented in the text, but 
also in graphing data generated by the student himself. Materials are included 
to facilitate the graph construction process, and suggestions for relevant 
activities are included in a Teacher's Guide. This guide, whlcti contains a 
complete print version of the program, also presents information pertinent to 
the development of systematic display-reading skills and strategies (for 
example, a systematic strategy for determining the coordinate values of a 
graph point using the index fingers of both hands). As Berla* (1972) and 
Berla*. Butterfield, S Murr (1976) discovered, the single most important 
factor distinguishing effective from ineffective display reading is the use 
of some type of systematic approach. 

All of the tangible displays in the program were designed and constructed 
for maximum readability based on information obtained In a number of investi- 
gations: structural characteristics of symbols within each symbol class (see 
reviews by Bentzen, 1980, and Nolan S Morris, 1971), differences 1^ elevation 
between and within symbol classes (Gill, 1973a; Nolan & Morris, 1971; Schiff 
S Isikow, 1966), discriminate line widths (Berla* S Murr, 1975b), sizes of 
point and areal symbols (Morris & Nolan, 1963; Nolan S Morris, 1971), struc- 
tural characteristics of Intersecting lines and their point of intersection 
(Easton & Bentzen, 1980; Schiff S Levi, 1966), trackability and memory rep- 
resentations of single versus double lines (Easton & Bentzen, 1980), minimum 
symbol separation (Bentzen, 1980; Nolan & Morris, 1971), stimulus redundancy 
in histograms (Schiff & Isiknw, 1966), overall display size (Armstrong, 1973), 
format for keys and labels (Schiff, 1982). 

One display feature in particular has proved to be troublesome in tangi- 
ble graph reading, namely, the grid background (coordinate reference system). 
Barth (1983a) found that It took blind students in grades 4-12 144% more time 
to track lines embedded in a raised grid than ones displayed against a smooth 
background. This occurred despite the fact that the tracked lines and grid 
Urte were highly discriminable. different in elevation, and separated by a 
distance of 3 m (.12 Inch). All grade levels were similarly affected. In 
an attempt to alleviate this problem, Barth (1983b) examined a new type of 
grid composed of incised lines. Compared to a raised grid, the incised grid 
facilitated performance on three graph reading tasks: (a) line tracking, 

5 



8 



(b) location of minimum and maximum data curve peaks* (c) location of point 
symbols. Performances on these tasks with the incised grid were in fact simi- 
lar to those achieved with no grid present. Furthermore* the incised grid 
did not impair the students 1 ability to locate accurately the x and y coor- 
dinate values of a graph point. Performances on this task were comparable to 
those attained with the raised grid. Consequently* the incfsed grid fowiat 
was used in many of the graphs included In the program. Raised yrids were* 
however* also used* since students will continue to encounter this format. A 
no grid format was used when the precise location of points in the graph 
space aid not represent an Important purpose of the graph (Schiff* 1982). 

As was indicated previously* both paper and plastic media are used 
throughout the program. The plastic displays are thermoform copies of foil 
masters produced with the Tactile Graphics Kit (Berth* 1982). This kit of 
tools and materials has the capability of embossing a foil master with seven 
linear symbols* seven point symbols* and four areal patterns* all of which 
have met stringent criteria of legibility. The paper displays were produced 
by a process which involves: (a) the enfcossing of an image in a folded zinc 
plate to form a male-female die set* and (b) the impressing of the image fn 
heavy braille paper by sandwiching the paper between the plates and applying 
pressure with a platen press. A new mechanical .embossing system is currently 
under development and will be used to produce the metal plate masters for the 
final production version of th* program. In comparison to the current method 
of plate embossing (largely a hand tool operation)* the new system will be 
superior in terms of the quantity (displays embossed per unit of time)* 
quality (tactual clarity)* versatility (symbol variety)* and consistency of 
its output. 

The last major phase of the project involved a field evaluation of the 
program. One group of braille reading students from grades 5-10 was desig- 
nated an experimental group and given instruction in the graph program. No 
instruction was given to another group of braille readers in grade* d-10* who 
thus served as a control against which the efficacy of the instructional pro- 
gram could be determined. The nrogram package used by the experimental group 
consisted of the following items: (a) student copy of Tangible Graphs pro- 
gram— 164 pages (in three volumes) of braille text and raised graphic displays* 
(b) materials for student construction of tangible graphs— 12 X 12 inch (30 X 
30 cm) corkboard* pins* rubber bands (various sizes)* and five sets of 
emboss'id graph sheets (three sizes of grid grain for the construction of bar 
graphs and line graphs* two sets of circles with different degrees marked off 
along the circumference for the construction of pie graphs), (c) test of graph 
skills* concepts* and operations (three volumes)— 64 multiple-choice ques- 
tions involving raised graphic displays (with braille answer sheets)* 
(d) Stokes Place Holder aid— lightweight metal sheet with magnet for place 
keeping on a brailled page (also provides rigid surface upon which to examine 
tangible graphic displays)* and (e) Teacher's Guide— print version of Tangible 
Graphs program (including* in addition* instructional information for the 
teacher) , 



Field Evaluation 



Method 



Subjects 

All 60 of the students who participated 1n the field evaluation used 
braille as their primary rode of reading. No student had less than 3 years 
experience 1n reading braille. Half of the students were from grades 5-7, 
half from grades 8*10. In each of these grade groupings. 60X wera enrolled 
1n residential schools for the blind* 40* 1n public school programs. None 
of these students had previously received any formal, systematic Instruction 
1n tangible graph Interpretation. Demographic Information by grade grouping 
and treatment condition 1s contained 1n Table 1. 

Table 1 

Demographic Data 

Grades 5-7 

Experimental Control 



Male-Female 
Age 

Grade placement 



7-8 
M * 12.3 

M * 6.3 
3D = .7 



9-6 

M » 12.8 
5b » 1.4 

M * 6.3 

5b = .8 



Grades 8-10 
Experimental Control 



M * 

§0 



10-5 

15.3 
■ 1.4 



M * g.3 

SO = .8 



7-8 

M = 15.5 
5b » 1.1 

M » 9.3 

SD « .7 



Field E valuators 

Teachers of the blind throughout North America served as field evaluators 
of the Instructional program and/or the graph tesc (see Appendix C). Partici- 
pating areas Included Arkansas* California, Connecticut* Florida* Illinois* 
Missouri* North Caroll j* Utah* Washington* and Ontario, Canada. Of the ?5 
teachers Involved 1n the study* 13 were from residential school programs and 
22 from public school* Itinerant programs. The primary teaching responsibili- 
ties of these Individuals varied considerably, encompassing such subject areas 
as braille reading* music* mathematics* language arts* social studies* science* 
typing* and Industrial arts. Twenty of the teachers worked with the students 
1n the experimental group* and 15 worked with those 1n the control group. 

Pro cedur e 

In Fall 1982, the graph Instructional program and the graph test were 
sent to the teachers 1n the experimental group. The teachers 1n the control 
group received only the graph test. A complete program and/or test was sent 
for each student participating 1n the study. 
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At the beginning of the evaluation period, all 60 students were adminis- 
tered the 64-1tem, multiple-choice graph test. Using a set of sample test 
''terns, the teacher first familiarized the student with the test format and 
tiie proper marking of the answer sheet (see Appendix D for test administra- 
tion instructions). The student then proceeded with the test proper. No time 
limit was imposed. Feedback of results was not provided. Immediately after 
testing, the completed answer sheets were mailed back to the American Printing 
House for the Blind for scoring by personnel In the Department of Educational 
Research. 

This initial* baseline testing was then followed by a period of instruc- 
tion in the giaph program for the 30 students in the experimental group. The 
30 students In tne control group received no graph Instruction during this 
period. The duration of the Instructional period and the actual amount of 
instruction given per week varied from student to student. This was due to 
(a) differences In ability and ease of learning between students, and (b) the 
workload (and consequent time constraints) of Individual teachers and/or stu- 
dents. All teachers were strongly urged, iwwever. to complete the entire 
instructional program with each student. In actuality, 23 (77*) of the stu- 
dents did complete the program. The amount of the instructional text covered 
by the remaining seven students ranged from 58% to 85%. 

All 60 students then completed their participation in the field evalua- 
tion with a second administration of the graph test. The administrations of 
the first and second testings were separated by an average Interval of 10.2 
weeks (3D * 2.4) for the experimental groups and 10.6 weeks (SD * 1.8) for 
the control group. The average amount of time spent in instructing students 
in the experimental group came to approximately 1.7 hours/week, with a range 
extending from less than 1 hour/week to 4.5 hours/week. 

The final responsibility of the teachers in both groups was to complete 
an evaluation questionnaire. For the teachers in the experimental ?royp, the 
questionnaire involved a comprehensive evaluation of the design and content 
of both the Instructional orogram and the graph test. Additional feedback 
was obtained from critiques made by these teachers as they progressed through 
the program during the instructional period. These coirments, criticisms, and 
suggestions for Improvement were recorded directly in the Teacher's Guide by 
each teacher. A questionnaire involving the graph test was the only feedback 
obtained from the teachers in the control group. Upon return of these 
materials and the results from the second testing, an honorarium of SlsO.OO 
was Issued to the teachers In the experimental group and $40.00 to those In 
the control group for their participation in the field evaluation. 

Resul ts 

Graph Test 

Test reliability . The reliability of the graph test was examined by 
calculating a Pearson Product Moment correlation coefficient on the pretest- 
posttest data of the 30 students In the control group. The resulting 
coefficient, r (28) = .g4, £ < .001, Indicated a high degree of consistency 
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between the scores obtained by the same Individuals on the two separate 
occasions, thus making 1t extremely Improbable that Individual differences In 
test scores are attributable to factors irrelevant to the knowledge and skills 
under consideration. 

Test daU—overaVl . Th? data from the two test administrations consisted 
of the percentage if test Items answered correctly by each of the 60 students. 
The students in th* control group received a mean score of 58% on the pretest 
and 58% on the post test, for no gain. In contrast, the students 1ct the expeH 
mental group received mean scores of 56% and 84%, for an average gain of 28% 
from pretest to posttest. The fadHtatlve effect of the Instructional pro- 
gram on graph reading performance, as evidenced by this difference between the 
groups, was found to be highly significant by a 2 (grade grouping) X 2 (experl 
mental treatment) Analysis of Covarlance (ANCOVA), F (1,55) « 232.68, p. < .001 
(see Table 2). The ANCOVA technique 1s the preferred method for analyzing 
data from a pretest-posttest control group design (Huck and McLean, 1975). 
Using the pretest scores as * covarlate, ANCOVA statistically controls for 
Initial differences between groups, thus providing a more powerful test of 
the experimental treatment, 1n this case, graph Instruction. 

Table 2 



Analysis 


of Cov?r1ance 


for Pretest- 


-Posttest Data 




Source 


SS 


df 


MS 


F 


Covarlate 


2679.30 


1 


2679.30 


140.93*** 


Grade grouping (t.) 


.023 


1 


.023 


< 1 


Instruction (I) 


«423.71 


1 


4423.71 


232.68*** 


G X I 


146.86 


1 


146.06 


7.72** 


Explained 


7255.68 


4 


1813.92 




Residual 


1045.66 


55 


t9.01 




Total 


8301 .33 


59 


140.70 





**p_ < .01 
***p_ < .001 

Further AHCOVA analyses Indicated a significant interaction between the 
treatment and grade griping factors, F (1,55) » 7.72, p_ < .01. While the 
experimental students 1n grades 5*7 Increased their scores from a man of 48% 
on the pretest 1o a mean of 80% on the posttest, fcr a gain of 32%, their 
counterparts 1n grades 7-10 only Increased theirs f»om 64% to 87%, for a gain 
of 23%. This difference was responsible for the irteraction effect, sincd 
the control students in both grade groupings showed essentially equal changes 
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in performance from pretest to posttest: 53% to 52% for grades 5-7; 63* to 
65% for grades 8-10. This comparability of control group gains undoubtedly 
accounts for the lac* of a main effect due to grade grouping (F < 1). For a 
summary of the test data, see Table 3. 

Table 3 



Graph Test: Mean Percentage Correct Responses 
( standard deviations In parentheses} • 







Experimental group 


Control 


group 


Grade groupinq 




Pretest 


Posttest 


Pretest 


Posttest 


5-7 




48 (10) 


80 (11) 


53 (15) 


52 (16) 


3-10 




64 (12) 


87 (10) 


63 (14) 


65 (13) 


5-10 




56 (14) 


84 (11) 


58 (15) 


58 (16) 


Test data— subscores. 


Additional 


information was gleaned from the test 



data by conducting separate analyses on two main subdivisions of the graph 
test. Questions 1-24 of the test were concerned primarily with more general dis- 
play reading skills and concepts. Questions 25-64 primarily involved skills 
and concepts specifically related to the reading of graphs. On the first 
subdivision of the test, the experimental students in grades 5-7 improved 
their scores from a mean of 70% on the pretest to 85% on the posttest. Their 
counterparts in the control group improved from 70% to 73%. The experimental 
students in grades 8-10 improved from 84% to 94%. A similar gain was made by 
the control students ii grades 8-10, from 77% to 86%. Overall, the experi- 
mental group improved uj a mean of 12% tr^jn; pretest to posttest (78% to 90%), 
the control group by 7% (73% to 80%). An ANC0VA revealed a significant effect 
due to instruction, F (1,55) « 14.61, p. < .01. In addition, the magnitude of 
the instructional effect was again found to depend on grade grouping, F (1.55) 
* 6.37, p. < .02. For this subdivision, of the test, the instructional pro- 
gram had a greater effect on the performance of the students in grades c -7. 

On the second subdivision of the test, the experimental students In 
grades 5-7 gained 41% from pretest to posttest (35% to 76%). The control 
students in grades 5-7 lost 4% (43% to 39%). In comparison, the experimental 
students in grades 8-10 improved by 33% (51% to 84%), while their counterparts 
in the control group decrased by 3% (55% to 52%). Overall, the experimental 
group's scores increased by 37% (43% to 80%). The control group's decreased 
by 4% (49% to 45%). The difference in performance between these two groups 
was found to be highly significant by an ANC0VA, F (1.55) - 236.75, £ < .001. 
The interaction between grade grouping and treatment, however, was not sif- 
nificant, F (1,55) * 3.33, p. > .05, indicating a comparable facilitative 
effect of Instruction for the students in both grade grouping*. For a summary 
of the data fro.,i the test subdivisions, see Table 4. 
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Table 4 



Graph Test Subdivisions—Mean Percentage Correct Responses 
(standard deviations In parentheses) 







Experimental group 


Control 


group 




Grade grouping 


Pretest 


Posttest 


Pretest 


Posttest 


1 


5-7 


70 (13) 


B5 (10) 


70 (13) 


73 (14) 




B-10 


84 (11) 


94 (07) 


77 (IE) 


86 (13) 


O p 

1A C 

a— 


5-10 


7B (14) 


90 (09) 


73 (09) 


B0 (09) 


3ns 25-64 
-related) 


5-7 
8-10 


35 (13) 
51 (15) 


76 (13) 
84 (12) 


43 (19) 
55 (15) 


39 (20) 
52 (15) 


Dues til 
(graph- 


5-10 


43 (16) 


80 (13) 


49 (IB) 


45 (19) 



Questionnaire 

Graph test . All 35 teachers participating in the field evaluation 
responded to questions concerning the graph test. The response to each ques- 
tion Involved the placing of a check mark In one of two boxes, labelled "YES" 
and "NO." For simplicity, the results for each question are reported as per- 
centages (see Table 5). 

Table 5 



Questionnaire Responses—Graph Test 



Question 


YES 


NO 


No response 


1. Do you think this test realistically assesses a 
student's 9rasp of graph reading skills and con- 
cepts? 


100% 


0% 


0% 


2. Were all of the skills and concepts covered In 
the test worth including? 




3% 


0% 


3. Were all the Important skills and concepts 
tested? 


B3% 


6% 


11% 


4. Was the wording of the questions acceptable? 


91% 


6% 


3% 


5. Was the format of the test acceptable? 


BB% 


6% 


6% 
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Table 6 (continued) 



Question 


YES 


NO 


No response 


22. Was the method of binding acceptable? 


100% 


0% 


0% 


23. Did your jtudent(s) use the Stokes »lace Holder 
aid? 


50% 


50% 


0% 


24. Was the Stokes Place Holder aid useful? 


40% 


50% 


10% 


25. Do you think It would be worthwhile to make an 
adaptation of this program for low vision stu- 
dents? 


95% 


5% 


0% 



In addition to responding to the questions in Table 6, the teachers were 
asked to indicate their satisfaction or dissatisfaction with the development 
of each of the skills and concepts covered in the program* In general » the 
degree of satisfaction was very high, The greatest dissatisfaction occurred 
for the handling of "interpolation" and "range," and even these were only a 
concern for 2056 of the teachers. 

Teacher's Guide . The 20 teachers involved with the experimental group 
also answered several questions on the program guidebook. Their responses 
are summarized in Table 7+ 

Table 7 



Questionnaire—Teacher's Guide 



Question 


YES 


NO 


No response 


1. Were the style and size of print used in the 
Teacher's Guide acceptable? 


95% 


0% 


5% 


2. Were the graphic displays In the Teacher's Guide 
acceptable? 


90% 


0% 


10% 


3. Was it easy to refer back and forth between the 
Teacher's Guide and the braille text? 


85% 


5% 


10% 


4. Did the Teacher Notes provide useful information? 


95% 


0% 


5% 


5. Were additional Teacher Notes needed? 


20% 


75% 


5% 



Item analyses . The percentage of experimental students giving a correct 
response was calculated for each question of the graph test (second adminis- 
tration). This was done to pinpoint areas in need of further development or 
revision. Overall, there were no extremely low percentages. The lowest 
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percentage obtained was, 1n fact, 57%, which occurred for two of the ques- 
tions. These questions were concerned with the location of the horizontal 
axis and the location of a graph point given its coordinate values. The stu- 
dents 1n grades 5-7 were largely responsible for these low percentages. 

Eight questions accounted for percentages 1n the 60-70% range. These 
questions were concerned with the following skills and concepts: perpen- 
dicularity, Intervals on a number line, Interpreting differences between bar 
pairs 1n a double bar graph, determining the x coordinate of a graphed point, 
determining the coordinate values of a point on a data curve, determining 
fractional values of sections of a circle, using a conversion graph, and 
determining the y value associated with a particular x value 1n a line graph. 
All other questions were answered correctly by more than 70X of the students. 

Discussion 

Two groups of blind students from grades 5-10 participated in a field 
evaluation of the Tangible Graphs program. One group received Instruction 1n 
the program, while the other served as a control. Both groups were adminis- 
tered a test of graph skills, concepts, and operations at the beginning and 
end of the evaluation period. The results of this study Indicate that sub- 
stantial gains 1n graph reading performance can be achieved with Tangible 
Graphs in a relatively short amount of time. 

The experimental students 1n grades 5-7 Increased their test scores from 
an average of 48% on the pretest to 80% on the posttest. The experimental 
students in grades 8-10 Increased theirs from 64% to 87%. The scores of the 
control students in both grade groupings rema' ned essentially unchanged, 
furthermore, if one considers only those test questions relating specifically 
to graph reading skills and concepts, as opposed to more general ones, an 
additional 9% Increase 1n test scores was realized by the experimental stu- 
dents. While the absolute level of performance was higher for the students 
in grades 8-10 on both the pretest and posttest, the lack of a significant 
treatment by grade grouping interaction effect Indicated a similar Improve- 
ment on graph related material for both grade groupings. This was not the 
case for the test material that was concerned primarily with more general 
display reading skills and concepts. For this material, 1n addition to a 
significant overall effect of Instruction, there was also a significant 
treatment by grade grouping Interaction. This latter effect appears to have 
occurred for several reasons. First, the experimental students 1n grades 5-7 
showed a greater improvement from pretest to posttest than those in grades 
8-10 (15% versus 10%). Second, the control students in grades 8-10 Improved 
as much as did their experimental counterparts, while the control students 1n 
grades 5-7 shored very little Improvement. Why the control students 1n 
grades 8-10 Improved while those 1n grades 5-7 did not 1s not clear. And, 
finally, 1t 1s possible that a celling effect was operating to limit the 
absolute amount of Improvement for the experimental students 1n grades 8-10. 
With a mean score of 84% on the pretest these students had little room for 
improvement on general display-reading skills and concepts. Those 1n grades 
5-7, starting with a mean score of 70%, had more to learn. It 1s possible 
that this ceiling effect also accounts for the significant treatment by grade 
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grouping interaction found for the test as a whole. The experimental stu- 
dents in grades 8-10 began the study with considerably more graph reading 
knowledge than those in grades 5-7 (64% as compared to 48%). Overall, the 
students in grades 5-7 had more room to improve. 

In retrospect, it would have been desirable to observe the effects of 
the program on an even younger sample of blind children, perhaps from grades 
3 and 4. While the relatively high performance of the students in grades 5-7 
on general display reading skills and concepts represents an encouraging 
finding, U limits the evaluation of the program's facilitation in this area. 
Because of cost considerations and time constraints, It was decided at the 
beginning of the project that the greatest amount of information could be 
obtained by concentrating on students who could be reasonably expected to com- 
plete the entire program within the time allowed. Since the reading diffi- 
culty of the program is approximately at the third grade level, it serins 
reasonable, however, to assume that younger students could benefit from the 
program, especially the first part, which is concerned with general displa> 
reading skills and concepts. 

Besides the small, but significant, effect of this first part of the pro- 
gram on experimental group scores as a whole, additional evidence for its 
facilitative effect can be seen in the improvement achieved by individual 
students. Two experimental students from grades 5-7 are particularly note- 
worthy in this regard. Beginning the evaluation period with rather low 
scores of 58% on general display reading skills and concepts, both improved 
considerably by the posttest, receiving scores of 100% and 96%. 

An exceptional amount of Improvement was also achieved by several stu- 
dents on graph related skills and concepts. Three students from grades 5-7 
Improved by 60% on this part of the test. Three otners Improved by 52%, 55%, 
and 58%. In grades 8-10, improvements by individuals were not quite as 
dramatic, the largest Increase being 42%. However, as noted previously, the 
students in this group had less room to improve. Three of the 15 experimental 
students in grades 8-10 did, In fact, Improve to the maximal extent possible, 
receiving perfect scores on this section of the posttest. Two others 
received a 95% on the postttest. 

Considering both group outcomes and the performances of Individual stu- 
dents, It is, therefore, clear that substantial gains in graph reading skills, 
concepts, and operations were realized by the students receiving instruction, 
relative to both their own pretest scores and to the scores obtained by the 
students in the control group. This is especially significant given the fact 
chat (a) 23% of the students In the experimental group d1<* not complete the 
program, and (b) the program was only taught for an averaje of 1 1/2 hours 
per week over a 10-week period. These limitations were largely due to time 
constraints. Several teachers suggested that two semesters (rather than one) 
would be more realistic for a thorough study of the program materials. In 
particular, they indicated the need for more time to do justice to the par- 
ticipatory exercises. 




In addition to the performance data collected or each student, subjective 
feedback on both the program itself and the graph test was obtalnsd from all 
of the teachers In the experimental group. The teachers In the control group 
provided feedback only on the graph test. In general, an extremely favorable 
response to the content and design of both the program and the graph test was 
found, Indicating a high degree of face validity for both. Criticisms and 
suggestions for Improvement were compiled and will be used, where deemed 
appropriate and feasible, to fine tune the program and test prior to produc- 
tion. None of the feedback received, however, indicated a need for major 
revisions in design or content. 

Dissemination of Information on the development and evaluation of the 
Tangible Graphs program has already been Initiated. In March, 1983, the 
author gave a presentation entitled "Graph literacy: A neglected area" at 
the First International Symposium on Haps and Graphics for the Visually 
Handicapped, in Washington, D. C. The symposium papers In print form will be 
published In September, 1983, by the Association of American Geographers. 
They will also be published In braille and recorded forms by the National 
Library Service. In Nay, 1983, the author made a slmlUr presentation In 
Atlanta, Georgia, at the American Foundation for the Blind's 35th research/ 
practice seminar. In addition, it is expected that an article on Tangible 
Graphs win be submitted to an appropriate journal in the field of visual 
impairment. Advertisements of the program will, of course, be carried in the 
American Printing House for the Blind's catalog a no brochures. Production of 
the program is expected to begin In the Winter of 1983-84, and should, there- 
fore, be available for the 1984-1985 school year. 

Suntnary 

An Instructional program was developed to facilitate blind students' 
understanding of graphs, an important and widely used Informational tool. The 
program employs a carefully sequenced Instructional approach, introducing 
fundamental graph reading skills and concepts in small steps, with each new 
step building upon previous ones. The student Is thus brought along slowly 
from elementary skills such as tactual discrimination and line tracking to 
more advanced skills such as the Interpretation of bar graphs and multiple 
line graphs. The program Is replete with tangible graphic displays, all of 
which have been designed for easy readability. Accessory materials which 
allow the student to conscruct his or her own graphs are also Included 1n the 
Instructional package. After completing the program, the student should be 
able to Interpret all four main types of graphs: pictograph, bar graph, line 
graph, and circle graph. It Is also expected that the program will have some 
positive carryover effects on the reading of other types of graphic displays, 
such as maps and diagrams. 

The effectiveness of the program was assessed using 60 braille readers In 
grades 5-10. The results of this evaluation indicated that substantial gains 
in graph literacy could be realized with the program In a relatively short 
amount of time. Subjective feedback Indicated an enthusiastic response to the 
materials on the part of both teachers and students. 

FOOTNOTE 

T. The~author wishes to acknowledge the contribution of Dr. Edward Berla 1 to 
the development of this instructional program. 
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General Skills, Concepts, and Operations 

discrimination of symbol shapes, textures, and elevations 

line tracking 

straight, curved 

below, above 

right, left 

or 

insidef outside 

length (short + long) 

height (low high) 

vertical 

horizontal 

diagonal 

parallel 

perpendicular 

intersection 

Intervals on a number line 

number line; one to one correspondence between Intervals and numerical pro- 
gression 

number line: one to many correspondence bteween intervals and numerical pro 
gression 

definition of key 

key interpretation 

row (table) 

column (table) 

row, column Intersections: c* lis (table) 
acquiring information from a 2-variable table 
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Graph-related Skills, Concepts, and Operations 
recognizing a pictograph format 
recognizing a bar graph format 
recognizing a line graph format 
recognizing a circle graph format 
locating and using a display title 
horizontal or x-axis 
vertical or y-axis 
origin 

grid (Cartesian coordinate reference system) 
interpreting a pictograph (whole symbols) 
interpreting a pictograph (fractional symbols) 

interpreting a bar graph (determining relative heights or lengths of bars) 

interpreting a bar graph (determining values for bar heights or lengths) 

Interpreting a double bar graph (determining differences between bar pairs in 
terms of within-pair bar differences) 

over and up relative to the origin 

determining upward or downward orientation of a line when scanning from left 
to right 

determining coordinate value of a graph point (one axis) 

determining coordinate value of a graph point (one axis) through interpolation 

locating a graph point, given its coordinate values 

determining coordinate values of a graph point (both axes) 

determining highest and lowest points of a graphed line 

determining relative areal sizes of sections of a circle 

determining proportions for sections of a circle 

interpreting a keyed circle graph 

24 

24 

ERIC 



trend (Increasing* decreasing* quadratic* zero) 
positive and negative slope 

comparing c !opes of two or more lines (absolute magnitude differences and rate 
of change differences) 

range 

determining the y-value associated with a given x-valje (line graph) 
determining the x- value associated with a given y-value (1 1ne graph) 
Interpreting a conversion graph 

Interpreting multiple-line graphs (point by point Interline differences) 
Interpreting Intersections 1n multiple-line gratis 
extrapoUdng (line graph) 
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Mr. Anthony Evancic, Educational Supervisor, Western Pennsylvania School for 
Blind Children, Pittsburgh, Pennsylvania 

Mrs. Dixie Howser, Mathematics Teacher, Kentucky School for the Blind, Louis- 
ville, Kentucky 

Mrs. Karol Jump, Itinerant Teacher (Math, Social Studies, Science)* Vista 
Unified School District; Vista* California 

Mrs. Stephanie Richards* Mathematics Teacher, Indiana School for the Blind, 
Indianapolis, Indiana 

Mrs. Margaret Ritchie, Mathematics Teacher and Vision Supervisor, Pasadena 
Unified School District, Pasadena, California 

Or. Charles Thompson, Associate Professor, Department of Early and Middle 
Childhood Education, University of Louisville, Louisville, Kentucky 

Mr. Timothy Yerian, Itinerant Teacher (Social Studies, Science), Hamilton 
County Public Schools, Hamilton County, Dhio 
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Ms. Linda Jane Almasy, Conectlcut State Board of Education & Services for tt.e 
Blind, Wethersfield, Connecticut 

Ms. Virginia Battles, Arkansas School for the Blind, Little Rock, Arkansas 

Ms. Suzi Bogom-Haselkom, Rockville High School, Vernon, Connecticut 

Ms. Ann* Lee Braunstein, Mira Loroa High School, Sacramento, California 

Ms. Cheryl Campodonico, Laurel wood Elementary School, Santa Clara, California 

Ms. Caroline Claverie, San Diego Unified School District, San Diego, California 

Mr. John Ed Chiles, Arkansas School for the Blind, Little Rock, Arkansas 

Ms. Fran Crystal, Victor Elementary School, Torrance, California 

Ms. Kathy Dempsey, Monterey County Office of Education, Special Education, 
Salinas, California 

Ms. Deanne Doorlag, San Diego Unified School District, San Diego, California 

Ms. Nancy Egel, Missouri School for the Blind, St. Louis, Missouri 

Ms. Vivian Glover, The Governor Morehead School, R&leigh, North Carolina 

Mr. Robert Gowan, Integrated Program for Hearing Impaired, Dysphasia, and 
Visually Impaired, San Mateo, California 

Dr. Fa reed Ha j, FDLRS, Miami, Florida 

Ms. Jan Harlow, Minnie Gant School, Long Beach, California 

Ms. Frank Holtzman, Jordan Intermediate, Garden Grove, California 

Ms. Juanlta Ramage, Oakland Unified School Oistrict, Oakland, California 

Mr. Tom Kellis. Berkeley High School, Berkeley, California 

Ms. Carol Lewis. Sunnyside School, Garden Grove, California 

Ms. Margaret Martin, Arkansas School for the Blind, Little Rock, Arkansas 

Mrs. Mary Ellen Melone, John Mills School, Almwood Park, Illinois 

Ms. Sue Mendiara, San Mateo County Office of Education, Integrated Program 
for Hearing Impaired, Dysphasia, and Visually Impaired 

Mrs. Kathy Miller, Glent^rd E. High School, Lombard, Illinois 

Mr. Dwight Moore, Utah School for the Blind, Ogden, Utah 

Mr. Donald Neale, W. Ross Macdonald School , Brantford, Ontario. Canada 
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Mr. Ned Olson, Washington State School for the Blind, Vancouver, Washington 

Ms. Josephine Pohl , Washington state School for the Blind, Vancouver, Washington 

Mrs. Louledean Ray, Missouri School for the Blind, St. Louis, Missouri 

Ms. Beverly Smay, San Diego Unified School District, San Diego, California 

Ms. Betty Stanley, The Governor Morehead School, Raleigh, North Carolina 

Mrs. BTanch Wilson, Utah School for the Blind, Ogden, Utah 

Mr. Robert Wilson, Castro Valley Unified School District, Castro Valley, 
California 

Ms. Sally Yeatman, McAteer High School, San Francisco, California 

Ms. Margaret Young, W. Ross Mac dona Id School, Brantford, Ontario, Canada 

Mr. Al Zlnmerman, Bolsa Erande School, Garden Grove, California 
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First Administration 



Record the student's name for Identifying code) and grade level at 
the top of the answer sheet. Also record your name and school . 

Say to the student: 

THE AMERICAN PRINTING HOUSE FOR TIE BLIND WANTS US TO TRY OUT A NEW TEST THEY 
HAVE DEVELOPED. THE PURPOSE OF THE TEST IS TO FIND OUf WHAT YOU KNOW ABOUT 
RAISED LINE DRAWINGS. MUCH OF THE TEST INVOLVES A SPECIAL KIND OF RAISED 
LINE DRAWING, CALLED A GRAPH. IN ALL. THERE ARE 64 MULTIPLE-CHOICE QUESTIONS 
FOR YOU TO ANSWER. YOU'LL ONLY DO PART OF THEM TOOAY. 

BEFORE YOU START THE TEST, LET'S GO OVER A FEW SAMPLE QUESTIONS. OPEN YOUR 
BOOKLET TO THE FIRST PAGE. AT THE TOP OF THE PAGE IS A QUESTION. READ THE 
QUESTION, EXAMINE THE RAISED DRAWING BELOW IT, AND CHOOSE YOUR ANSWER FROM 
THE FOUR POSSIBILITIES AT THE BOTTOM OF THE PAGE. THEN GO TO THE ANSWER 
SHEET, FIND THE RIGHT QUESTION NUMBER, AND CIRCLE YOUR ANSWER. 

Point out to the student that the four answers at the bottom of 
the page are identical to those appearing on the answer sheet. 

HOW GO TO THE NEXT PAGE AND ANSWER THAT QUESTION. 

Point out to the student that there 1s only one question per page 
and that there are always four answers to choose from. 

NOW TURN THE PAGE AND ANSWER THE LAST SAMPLE QUESTION. 

Make sure that the student understands the test format and the 
proper usage of the answer sheets before proceeding to the test 
questions. 

OK, YOU ARC READY TO START ANSWERING THE TEST QUESTIONS. CIRCLE AN ANSWER 
FOR EACH QUESTION. IF YOU ARE NOT SURE WHAT THE CORRECT ANSWER IS, TAKE A 
GUESS. DO YOU HAVE ANY QUESTIONS? NOW TURN THE PAGE AND BEGIN. 

Note: This is not a timed test. However, the student should be 
encouraged not to spend an excessive amount of time on any par- 
ticular question. 

Monitor the student. Make sure that s/he is circling an answer 
for each question. Also make sure that the question number being 
markelTon the answer sheet corresponds with the question number 
1n the test booklet. 

If the student wishes to change an answer, put an X through the 
first answer and circle the new answer. 
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Before proceeding with the second test session, remind the student 
to mark an answer for each question. Once again, monitor the stu- 
dent's progress. 

Do not tell the student that s/he will take the test again at the 
end~oT the semester. Doing so may bias the results of the second 
administration. 

Return the completed answer sheets 1n the self-accessed, stamped 
envelope. 
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Second Administration 



Record the student's name (ur Identifying code) and grade level at 
the top of the answer sheet. Also record your name and school . 

Say to the student: 

THIS IS THE TEST ON RAISED LINE DRAWINGS AND GRAPHS THAT YOU TOOK A FEW 
MONTHS AGO. I WOULD LIKE YOU TO TAKE IT ONE MORE TIME. ONCE AGAIN* THERE 
ARE 64 MULTIPLE-CHOICE QUESTIONS FOR YOU TO ANSWER. BEFORE YOU START THE 
TEST, LET'S GO OVER A FEW SAMPLE QUESTIONS. OPEN YOUP. BOOKLET TO THE FIRST 
PAGE AND ANSWER THE QUESTION. 

Have the student answer the three sample questions. Make sure s/."te 
understands the test format and the proper usage of the answer 
sheets. 

YOU ARE NOW READY TO START THE TEST. REMEMBER TO CIRCLE AN ANSWER FOR EACH 
QUESTION. IF YOU ARE NOT SURE WHAT THE CORRECT ANSWER IS, TAKE A GUESS. DO 
YOU HAVE ANY QUESTIONS? OK, BEGIN. 

Monitor the student's progress. 



ERIC 
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